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Abstract 

The extraordinary computational power of the brain may be related in part to the fact 
that each of the smaller neural networks that compose it can behave transiently in many 
different ways, depending on its inputs. We use contraction theory to extend earlier work 
on synchrony and symmetry, and exploit input continuity of contracting systems to ensure 
robust control of spatial and spatio-temporal symmetries of the output with the input. 

1 Introduction 

The brain is often described as being composed, in part, of a very large number of small "identical" 
functional units pQ. Cortical computation, for instance, is commonly viewed as being organized 
around cortical columns [21 El IH E]- I n this context, a frequent suggestion is that the overall 
computational power of the brain may be related to some sort of combinatorial complexity [5] , and 
to the fact that each part of the brain is reused for different computations. 

At the level of individual units, although high behavioral variety could be explained by some 
learning process El IHJ EH IH] or internal change, it is unlikely that such changes occur in very 
short periods of time. Instead, the most efficient source of behavioral variety could be simply 
to have a high input dependency, exploiting the nonlinearity of biological neural networks. In 
other words, depending on its input, a functional unit could behave in very diverse ways, though 
remaining stable and robust against noise and small variations in the input. 

Intuitively, it is also known that sensory "input" enrolls only 5% or so of the connections to the 
thalamus p2], and that a similarly small percentage describes connections from the thalamus to 
input cortical layers [13]. Recent research suggests that this "paucity of input" between different 
regions of the brain is actually quite general |14j . 
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Inspired by this, we will try to draw a generic framework allowing to observe neural systems 
under some "controlling" input. To this effect, we introduce "input continuity" analysis which 
will provide a way to describe the properties of a unit's output knowing the properties of its 
input. This framework has broader possible uses and applications than used in this paper and will 
be discussed in the appendix. Here the main use of the "input continuity" will be its link with 
contracting systems |15j . giving us a simple way to change the behavior of systems as will be shown 
with some toy examples in Section [5] also displaying some interesting results about symmetries and 
contracting systems, results exposed in Section [3] of the paper. 

Indeed the study of symmetries is important in dynamical systems [TOl dZj and more specifically 
in neural networks. It strongly influences, as we will see, synchrony and polysynchrony (concurrent 
synchronization), concepts playing an important role in neurobiology [HI [191 ED]- To this matter 
we will try to cover Lie continuous symmetries and spatio-temporal symmetries, giving some 
interesting tools to ensure this symmetries in the output. Most of those are based on contracting 
systems. Let us first recall different contraction theorem and properties. 

2 Contraction 

Essentially, a nonlinear time-varying dynamic system will be called contracting if initial conditions 
or temporary disturbances are forgotten exponentially fast, i.e., if trajectories of the perturbed 
system return to their nominal behavior with an exponential convergence rate. It turns out that 
relatively simple algebraic conditions can be given for this stability-like property to be verified, 
and that this property is preserved through basic system combinations. 

A nonlinear contracting system has the following properties [151 ED EZl |23] 

• global exponential convergence and stability are guaranteed 

• convergence rates can be explicitly computed as eigenvalues of well-defined symmetric ma- 
trices 

• robustness to variations in dynamics can be easily quantified 
2.1 Basic results 

Our general dynamical systems will be in W 1 , deterministic, with / a smooth non linear function. 

x = f(x,t) (1) 
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The basic theorem of contraction analysis, derived in |15j . can be stated as: 

Theorem 1 (Contraction). Denote the Jacobian matrix of f with respect to its first variable by 
■gt. If there exists a square matrix Q(x,t) such that Q(x,t) T Q(x,t) is uniformly positive definite 
and the matrix 

F =(e + e|)e- 

is uniformly negative definite, then all system trajectories converge exponentially to a single trajec- 
tory, with convergence rate \ sup xt A max (F)| > 0. The system is said to be contracting, F is called 
its generalized Jacobian, and 9(x,t) T Q(x,t) its contraction metric. 

It can be shown conversely that the existence of a uniformly positive definite metric 

M(x,t) = &(x,t) T Q(x,t) 

with respect to which the system is contracting is also a necessary condition for global exponential 
convergence of trajectories |15j . Furthermore, all transformations G corresponding to the same M 
lead to the same eigenvalues for the symmetric part F s of F [22], and thus to the same contraction 
rate | sup^ A max (F s )|. 

Remark 2.1. In the linear time-invariant case, a system is globally contracting if and only if it is 
strictly stable, and F can be chosen as a normal Jordan form of the system with the coordinate 
transformation to that form |15j . 

Remark 2.2. Contraction analysis can also be derived for discrete-time systems and for classes of 
hybrid systems [2"T] . 

Finally, it can be shown that contraction is preserved through basic system combinations, such 
as parallel combinations, hierarchies, and certain types of negative feedback, see [15] for details. 



2.2 Contraction toward a linear subspace 

The main theorem of |24J gives us the ability to prove contraction of all solutions to a subspace 
M. of the state space. It is a powerful tool that we will use in the symmetry studies, and can be 
stated as 

Theorem 2. Consider a linear flow-invariant subspace M. of the system (f(Ai) C M. ) and the 
associated orthonormal projection matrix U T U (we have V V + U T U = I n and x G M. -<=>- 
Vx = 0). All trajectories of the system converge exponentially to M. if the system 

y = Vf(V T y,t) (2) 
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is contracting with respect to a constant metric. If furthermore we denote the contraction rate for 
by A > 0, then the convergence to M. will be exponential with rate A. 

We will call the above condition, V T fV contracting for a constant metric, contraction toward 
M. 

Remark 2.3. The theorem uses mainly two independent hypotheses 

• Contraction condition of Equation [2] : / contracts toward Ai 

• Invariance condition of Ai : f{M) C M. 

2.3 Contraction yields robustness 

It can be shown that (see section 3.7 in [T5] for a proof and generalization) 

Theorem 3 (Contraction and robustness). Consider a contracting system x = f(x,t), with a 
constant metric 6 and contraction rate A. Let P\{t) be a trajectory of the system, and let P%(t) be 
a trajectory of the disturbed system 

x = f(x, t) + d(x, t) 

Then the distance R(t) between Pi(t) and p2{t) verifies R(t) < sup xt \\d(x,t)\\/X after exponential 
transients of rate A. 

3 Symmetries and contraction 

The symmetries of a neural network, defined in a broad sense, can reflect important properties. 
There are many different ways to express symmetries, such as symmetry of the input, the output, 
or the system, all of which are usually interdependent. 

3.1 Generic 7 operator 

Consider a dynamical system x = f(x,t). A linear operator 7 acting over the state space defines 
two usual "symmetries" : 

• symmetry of the system state: if x = 7X, we will say that x is 7-symmetric 
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symmetry of the dynamical system : if 7/ = fj, we will say that / is 7-equivariant [TTJ 



Note that any linear operator belongs to GL, the general linear group, see for example [16] also 
using linear operators as symmetries. 

The following simple result shows that a contracting dynamical system "transfers" its symme- 
tries to its state trajectories. 

Lemma 3.1. If f is j-equivariant and contracting, all solutions converge exponentially to a unique 
^-symmetric trajectory x(t). 

Proof. Since the system is contracting all solutions converge exponentially to a single solution x(t). 
But jx(t) is also a solution : 

4 (ix(t)) = 7±(t) = jf(x,t) = f(jx,t) 
hence x(t) — > jx(t) exponentially. □ 

A simple example: permutations 

Let us illustrate 7-symmetry in the simple discrete case of a permutation operator. 

Consider x G E = M n , and write it ), the action of a permutation 7 on E is 

defined by 7a; = (x 7 (i), . . . , %(»»))• 

Decompose 7 into disjoint non-trivial cycles, 

7 = a o o x . . . a p 

and decompose the space accordingly as 

E = R n = E ao x E n x • • • x E ap x E Iq 

with E 1 ,,.. the space of action of 0{. 

7 symmetry of the state space describes concurrent synchronization: in each subspace E a . the 
solution is synchronous, thus yielding p co-existing synchronous assemblies, as illustrated in Figure 
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7 = (01)(23)(4) 

E = £7(oi) x £ (23 ) x R 

X = [Xq, Xi, X 2 , X 3 , X4) 
7X = (xi,X ,X3,X2,X4) 

We have / 7-equivariant, indeed 7/ = fj : 

/ 2 (xo,Xl,X2,X3,X 4 ) = /l(Xi,.To,X3,X2,X 4 ) 
fl{XQ, Xi, X2, X 3 , X4) = f2{Xl,Xo,X3,X2,Xi) 

f 4 (x ,x 1 ,x 2 ,x 3 ,x 4 ) = f 3 (x 1 ,x ,x 3 ,x 2 ,x 4 ) 

f3{x ,X 1 ,X2,X 3 ,X 4 ) = U(x 1 ,Xo,X 3 ,X2,X 4 ) 
f 5 {Xo,X u X2,X- 6 ,X 4 ) = f 5 {Xi,X ,X; h X 2 ,X 4 ) 

And 7 symmetry of x would be synchrony of Xq with X\ and X2 
with x 3 : 

Xq = Xi 
X 2 = X 3 




x 2 






x_3 




• • 




X 
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Figure 1: Toy example which could model a three layered network. 



3.2 Spatio-temporal symmetries 

A straightforward extension of spatial symmetries are spatio-temporal symmetries. Inspired by 
the theory developed by Golubitsky et al. [I7J I2E1 , we define a spatio-temporal symmetry 
h = (7, T) using a spatial symmetry 7 and a period T, according to 

hx{t) = jx(t + T) 

Unlike the H/K theorem of Golubitsky et al. (23 [27|, we do not restrict ourselves to permutation 
for the spatial symmetry, but, to some linear operator 7 such as there exists an integer p 7 , classically 
called the order of 7, such that 7 P7 = Id. 

Example : Consider a 3-ring with the /t-symmetry : 

7 x 2 = x 2 
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x is /i-symmetric when 



xi{t) = -j=( Xl {t + T)+x 3 {t + T)) 
hx(t)=x(t) <==^ { x 2 (t) = x 2 {t + T) 

X3 (t) = -^(x 3 (t + T)- Xl (t + T)) 

There is a strong interaction between x% and x\ but interestingly hx(t) = x(t) X\(t) = 

Xi(t + 8T) and for 2i(0) 7^ 0,xi(t) 7^ x\{t + T) 7^ the same holds for x 3 but x 2 (t) = x 2 (t + T). 
This shows that two different rhythms have to coexist. □ 

An associated definition can be given for a dynamical system. Specifically, we will say that the 
system x = f(x,t) (or its dynamics /) is h-equivariant if 

/( 7 x(t),t) = 7/(x(t),t + T) (3) 



We then obtain for spatio-temporal symmetries a result similar to Theorem 3.1, describing the 
transfer of symmetries from system dynamics to system trajectories. 

Theorem 4. If f is contracting and h-equivariant, then after transients the solutions are p y T 
periodic and exhibit the spatio-temporal symmetry h. 

Basically, all the solutions tend to a periodic solution x p (t) with the symmetry h : x p (t) = 
7x p (t + T). This result is an extension of the result that a periodic contracting system exhibits a 
unique solution of same period [15]. 

Proof. If x(t) is a solution, then 72 (t + T) is also a solution: 

j f ( 7 z(t + T)) = 7 x{t + T) — 1 f{x{t + T),t + T) — f( 7 x(t + T),t) 

Thus, since / is contracting, x(t) —>■ jx(t + T) exponentially fast. This in turn shows that the 
solution tends to a periodic signal exponentially : by recursion 

x(t) -> 7^x(t + p 7 T) = x(t + p-yT) 

so that Vi G [0;p 7 T] a;(t + np^T) is a Cauchy sequence, and therefore the limiting function 
lim^oo x(t + np^T) exists, which completes the proof. □ 
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3.3 Spatial symmetries accomodate weaker contraction 



When dealing only with spatial symmetries, we can weaken the contraction condition on / while 
still transferring the symmetries of / to the system trajectory. 

Conisder the linear subspace of 7-symmetric states, M. 1 = {x, x = 7x}. Recall first a standard 
result linking the symmetry of the system to this linear subspace: 

Lemma 4.1. / is 7 equivariant ==>- My flow invariant 

Proof, if x G M y and / is 7-equivariant : x = f(x) = f(jx) = jf(x) = 7X □ 
In this context, we can thus write Theorem [2] as 



Lemma 4.2. If My is flow-invariant by f (or sufficiently, by Lemma 4-1 , iff is ^-equivariant) and 



f contracts toward My, then all solutions x{t) converge exponentially to ^-symmetric trajectories. 
We will denote by V^Vy the orthogonal projector on M 7 X . 

As these lemma shows, the more generic 7 is, the stronger the contraction condition. In the 



generic lemma 3.1 the hypotheses of symmetry and contraction are independent on the contrary 



to last lemma 4.2 where the contraction condition depends explicitly on 7. 



This link between symmetry and contraction is not particularly convenient, since later in section 
[5] we will aim to shape the equivariance of /, and thus the symmetries of the output, while 
preserving sufficient contraction properties. We now show how to avoid this direct dependence. 



3.4 M-aii an d M.Y spaces 



We show how to strengthen the contraction condition of lemma |4.1| to make it independent of 
the symmetry condition, or at least allowing to have the theorem hold with a set T of different 
symmetries. 

First note: 

Lemma 4.3. The choice ofV to represent the orthogonal projector has no effect on the contraction 
toward M L . 



See proof in appendix 7.6.2 The proof also shows that, by contrast, using a non orthogonal 



projector V2 = TV with T square invertible is not sufficient in general. 
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Remark 3.1. The above lemma shows that the contraction condition toward a subspace is preserved 
when applying an orthonormal transformation M to the projector V. Moreover one can also 
trivially change the metric with an orthonormal transformation : 

MQVfVTQ^M 7 < QVfV T Q- 1 < QMVfV T M T Q- 1 < 



Now the main result of this section : 

Lemma 4.4. Consider two linear subspaces M and M2 , with M C M.2- If f contracts toward 
M, then f contracts toward M.2- 

More precisely, let V T V (resp. V^V-i) be an orthogonal projector onto M x (resp. M 2 )- If 
f contracts toward M with constant metric B ; then taking U T a partial isometry from E M ± to 
E M ±, with kernel and image Im(QVV 2 T Em 2 ) > f contracts toward M.2 with constant metric 

e 2 = uqvv 2 t 



See proof and definitions in appendix (7.6.1) 



Remark 3.2. One would be tempted to set U T = QVV 2 T but this is possible only when 9 itself 
is an orthonormal transformation. In particular when = Id we can set U T = VV 2 T giving us 
6 2 = Id 



The main consequence of lemma 4.4 is the ability to determine a sufficient contraction condition 
for a set T of symmetries. Indeed we just showed that a sufficient contraction condition would be 
the contraction toward Mr = n 7 er^7- This condition and the equivariance with respect to a 



specific 7 allow lemma 4.2 to be applied to this 7. 



In the generic linear case, there is no non trivial unifier, since the intersection of all linear 
subspaces is reduced to {0}, corresponding to the contraction of the full system. 

But when considering the permutations, the common subspace exists : M a ii = {Vi, Vj, Xi = 
Xj}. This subspace of full synchrony will be very handy and may play an important role in neural 
networks. 

Moreover the contraction toward Mail will be quite easy to prove when using eventual symmetry 



of the system. To have more insight into the kind of computation, see Section 7.3 



In summary to the contraction and symmetry section, the main theorem we will use can be 
stated as 

Theorem 5. Consider a 'y-equivariant or with M 1 flow-invariant system, and assume one of the 
following contraction properties (sorted by decreasing strength) 
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• contraction of the system 

• contraction toward Air with 7 e T 

• with 7 a permutation, contraction toward Ai a u 

Then all solutions converge exponentially to a 7 -symmetric trajectory x(t). 



Proof. We only apply Lemma [4.2| and [3.1| The only change is the generalization in the fully con- 
tracting case by using }A 1 flow-invariance hypothesis : a contracting system has a unique solution 
independent of the initial conditions, then taking a trajectory beginning in Ai 1 will stay in M. 1 
by flow- invariance thus forcing the unique solution to be in Ai-y. □ 

Remark 3.3. All the symmetries of /, complying the theorem, will be transferred to the trajecto- 
ries. The system will maximize synchrony : for example, if / complies the theorem with 7 = (0, 1) 
and 7 = (1, 2) then the system will lead to x = 27 = x 2 - 



4 Input continuity 

4.1 Input continuity motivations 

We now exploit these results on global symmetries in a control framework, by introducing control 
inputs in the system to modulate its dynamics. 

We will observe / under the influence of some input u: 

x(t) = g(x,u(t),t) = f(x,t) (4) 

The input u doesn't represent all the input of the actual system, the rest of the actual input can 
still be hidden as before inside the function g. This choice underlines the fact that we want to 
study the system response to a decisive part u of the actual input. Then the idea is to control the 
output with the input to get the property that we want see Section |5j In an in vivo situation, we 
can see all the feedback loops from the upper part of the brain to the bottom part of the brain as 
control inputs u, but also the input from the bottom to the top, and every other connections. 

The response to u of the system will be some output s defined by the state of the system. 
Typically we will use s(t) = x(t) or some projection of the state s(t) = Px(t). 

With this point of view we introduce input continuity analysis, in order to describe the proper- 
ties of a system's output knowing the properties of its input while ensuring stability and robustness. 
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As a general matter, we want to be able to say two things, first "if u has this property then s 
will have that property" and secondly "if the input u is close to an ideal input u' then s will be 
close to the ideal output s"'. This will be formalized by the notion of "input continuity" : 

Ve > 0, 3r) > such as d\(u , u) < rj =>■ 40', s) < e (5) 

d\ (resp. d\) is a pseudo distance of the space of the input u (resp. the output s). This pseudo 
distances help us to define the notion of being close as traditionally but also the properties cor- 
responding to the chosen pseudo distance : if d\(u',u) = 0, then u and u' are in the same class 
defining some property see Section |7.2.2 for details with some interesting examples shown in Section 

Depending greatly on the distance we use, input continuity will be a modular tool to ensure 
robustness of specific properties of the output given the properties of the input. 

The modularity of input continuous block is something very generic and powerful, more discus- 



sion can be found in section 7.2.1 but from now we will restrict ourself to the study of a powerful 



input continuity found in contracting systems. 



4.2 Input continuity and contraction 



There is no generic way to show input continuity of a system. Depending on the type of system 
(discrete or continuous) and the distance we use, we would have to examine each case we encounter. 
But in the case of a contracting system, we can state some powerful generic properties. This will 
allow us to combine Theorem [5] and the input continuity without any effort, the contraction being 
already an hypothesis. The main tool to study input continuity of a contracting system is its 
robustness : 



4.2.1 Contracting systems 

We will compare the perturbed state s' with perturbed input v! and the wanted state s with perfect 
input u : 

s = f(s,u,t) 

s> = f(s',u',t) = f(s , ,u,t)+h(s',t) 
with h(t) = f(s',u',t) — f(s',u,t) 
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Then, if / is contracting, we can prove with the generalized form of the robustness seen in [15] 
that 

R + XR < \\h(t)\\ (6) 

R(t) < e- x ^R(t )+ f e- x(t - T) \\h(r)\\dr (7) 

Jto 



with r = s' — s, R(t) = ||r(t)||, |.| the norm of the space in which / is proved contracting with 
contraction rate A. By convention we will have R(—oo) = 0. 

Remark 4.1. If the contraction analysis uses a metric, it is reflected in the norm ||.||, for instance 
in the case of the use of the 2-norm ||.|| 2 and a metric we will use |.| = ||G _ 1 1 2 

We can prove the input continuity considering the space of the input signal and output signal 
with these two norms : 

\\*\\Z°* = Sup T<t {(Mr\\)} (8) 
iV~J5'(x) = / \\x(r)\\e~ a ^ dr witha>0 (9) 



OO 



Theorem 6. If all the signals are bounded and f is contracting and uniformly continuous in time, 
then we have the input continuity using the uniform norm pi) in both input and output space. 



Proof. From [6] we have : HrH^ 00 '* < H^H^o 00 '*- In the mean time, contraction gives us space 
continuity, then using the hypothesis of uniform continuity in time and the Heine's theorem over 
the compact space of bounded signals, 3k G K, H^H^ 00 '* < k\\u' — □ 

Note that the boundedness of the input signals is a plausible condition in vivo. 



In our control context, a more flexible and meaningful tool is the norm (|9j) with exponentially 
fast forgetting : 

Theorem 7. If all the signals are bounded and f is contracting and uniformly continuous in time, 
then we have the input continuity with N~T,f in the input space and N^.f in the output space. 



See proof in appendix |7.4.1 



Remark 4.2. When dealing with this kind of norms, Lemma 10.2 can be very convenient 
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4.2.2 Systems contracting toward a subspace 



With contraction toward linear subspace, we want to ensure the property "we are in Ai u which 
can be easily characterized with a generic semi-norm see Section 7.2.2 for more explanations : 

N M (x) = \\Vx\\ 



We can now state an adapted version of Theorem [7j 

Theorem 8. If all the signals are bounded, f uniformly (in time) continuous, with Equation^ 
contracting and A4 flow- invariant, then the system is input continuous with input norm N~ y* and 

output pseudo norm N~™' ■ 

Remark 4.3. This obviously works with the uniform norm in the same way. 



Proof. We can apply Theorem ([7]) on the contracting system ( p^0[ ) with space norm ||.||, giving us 
input continuity of this system with norm N~Tn ( resp. N^Tu ) as input norm ( resp. output 
norm ). Using notation of the Theorem, we can link y and x, indeed if we set y = Vx we get the 
system 

y = Vx = Vf{x) = Vf(V T y + U T Ux) (10) 

which is contracting with respect to y, equivalently with the contraction of the system (|2]).Then 
we have Nj^(x) = \\Vx\\ = \\y\\ so we can directly apply the result to the original system using 
N~n'* as output norm. □ 



5 Control 



With the power given by theorem [5] and the flexibility given by input continuity, we can now get 
the system to exhibit specific symmetries with the help of a small controlling input. The global 
property of contraction and input continuity will be required to robustly do transient and multiple 
changes in the system and the symmetries of the output. 



5.1 Main idea 



Rather than looking at symmetrical solutions a system may exhibit, as in the H/K Theorem of 
Golubitsky et al. p2J E5j EHJ [27], we consider what symmetries the system may exhibit when 
submitted to specific external inputs. 
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We consider a system of the form 



x = f{x,t) = g(x,u(t),t) 

where now u(t) is a "control input". We will control the symmetry of the system's output by 
modifying its input. To do so we will use the theorems [5] and [4] on the function /. We will need 

• a symmetry condition (7-equivariance or flow-invariance) 

• a contraction condition (contraction or contraction toward a subspace) 



The contraction condition (in any form) will give us input continuity as shown in section 4.2 
allowing us to plug the input at any time instead of controlling the system from the beginning, and 
still be exponentially close to the desired output. The symmetry condition will lead the system to 
a state expressing the desired symmetry. 

The input can have different functions. It can determine the contraction condition as explained 



in the following 5.3, but also, and mainly, change the symmetries of the system, as we now detail. 



5.2 Selection of spatio-temporal symmetries of the system 

We first need to link the symmetries of / and those of g and u. g will be said h-equivariant if 

g(ix,iy,t) = yg(x,y } t + T) 
Theorem 9. g h-equivariant and u h- symmetric ==>- f h-equivariant 



Proof. 



f(yx(t),t) = g{yx(t),u(t),t) = g(jx(t),yu(t + T),t) by symmetry of u 
r )f{x{t),t + T) = ryg(x(t), u{t + T),t + T) = g(yx(t),"fu{t + T),t) by equivariance ofg 



□ 



In the general case, g h-equivariant is not sufficient, moreover, increasing the symmetry thanks 
to the input is very unlikely, since it would require an intelligent input, quite as complex as the 
neuron model. This is not our goal since we consider the input to be "small", and the neuron model 
a realistic non linear dynamical system. Thus for practical purposes the theorem is an equivalence. 
Once the symmetries T g of g are determined, we can set an input with the symmetries T u to control 



14 



the final symmetries F by considering r = T g fl T u , i.e., intersecting the symmetries of g with those 
we set in the input. 

Example : Consider the simple dynamics 



Here g is h = ((1, 2, 3), 7r/3)-equivariant, thus also h 2 = ((1, 3, 2), 27r/3)-equivariant and h 3 = 
(id, 27r)-equivariant, etc. Taking for example u /i 2 -symmetric, but not /i-symmetric, we have / 
/z 2 -equivariant but not /i-equivariant. Note that then the solution will be 6ir periodic instead of 
2n periodic, and also that nothing is needed or proved about the respective phases of the different 
signals and elements. 

This also shows that the creation of symmetries is unlikely. If g was only /i 2 -equivariant, having 
u /i-symmetric will not make / /i-equivariant, but only /i 2 -equivariant. □ 

5.3 Control of the contraction condition of the system 

Having the system always contracting will probably not be the generic case and the most biolog- 
ically sound. Rather, we want to "turn on" the contraction property at a specific time using the 
input. It can be represented by : 



Having k big enough and the activator Xon — 1, the system will contract. With some systems like 
a set of FitzHugh-Nagumo elements, putting such a term only over the potential variables will give 
contraction toward M. a ii- 

This "contracting input" is a transient negative feedback loop which can be turned on and off 
through the control of the activator. This can't be as simple in neural models, but we propose a 
quite meaningful and simple "implementation" : 

We consider the circuit of Figure [9] but without delay d. This circuit seems to be part of the 
neighborhood of many cortical pyramidal cells in the treatment of extracortical afferent excitations 
[2%] . We suggest a behavior : The pyramidal neuron x v would have lots of gap junction with its 
touching inhibitory interneuron X{. The interneuron being way smaller will be driven by the 
pyramidal one, so that Xi ~ x p . Next setting a low firing threshold for the interneuron would 
allow to have it spiking proportionally to its potential. The resulting inhibition of the pyramidal 




x\ + u\{t) + sin(t) 

x\ + u 2 (t) + sin(t + 7r/3) 

x\ + u 3 (t) + sin(t + 27r/3) 



(11) 
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neuron will thus have the desired shape ~ —k.x p . Input continuity permit to compute the distance 
between this implementation and the perfect instantaneous negative feedback. 

The activator will then be easily implemented by some inhibition of the interneuron : no 
inhibition means Xon — 1, otherwise. 

The first two examples use the activated contraction to control spatio-temporal symmetries 

or section 



(example of section 5.4.2 
M a u idea. 



5.4.1). Then we show in more details a grid example using the 



5.4 Examples 

Throughout this section we illustrate some of the above possibilities shown through basic examples, 
mostly using FitzHugh-Nagumo neural models, 

v = via — v)(v — 1) — w + I , . 

■ R( \ 12 

a = 6,/3 = 3,7 = 0.03 

with / the synaptic input function. Although most of the time we refer to our system elements 
as "neurons" , one should notice that more generally the theory developed here applies to / rep- 
resenting neural networks, whose equations can be actually very similar to FitzHugh-Nagumo 
models. 

The use of FitzHugh-Nagumo neural models is motivated by its simplicity while still a reason- 
ably descriptive neuron model, and it has the desired properties of contraction toward M. a ii when 
coupled only through the potential variable see |24j. This property is kept when using the more 
precise Hodgkin-Huxley model see [29J. 



5.4.1 Leading to unstable state : transient synchronization 

In this example we will use the action of a contracting input making the system contracts toward 
Aiaii from time 75 to 95. This transient contraction results in a transient synchronization, which is 
often considered as a very important neural processing process [301 13l] . Consider the system seen 
in Figure [2] Neuron 1 and 2 are two FitzHugh-Nagumo neurons with an inhibitory symmetrical 
link between them. As we can see Figure [3] before we put the contracting input, the mutual 
inhibitory link leads naturally the system to antiphase. But after synchronizing the two neurons 



by force with the input, they stay in the unstable state where they are equal see Figure 3a, this 



during transient when some level of noise is added see Figure 3b 
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This example illustrates the idea that with the input we can lead the system to a non 'natural' 
state, in much more complex networks this could be some basic phenomenon to allow different 
computations with the same network. 




U(t) 



Figure 2: System for transient synchronization 



x\ = f(xi) - fix 2 + e + 1\ 
%2 = f(x 2 ) - + e + I 2 
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5.4.2 Choose the spatio-temporal symmetry in a 3 ring hysteresis system 

We have here Figure [4] a ring of 3 FitzHugh-Nagumo neurons, each inhibiting its right neighbor. 
This system as we can see Figure [5] has a stable state where none of the neurons spike (here e is 
not big enough to make them spike because of the overall inhibition) but also another stable state 
((1, 2, 3), T/3) symmetric, where the neurons are spiking one after the other and each neuron has 
a period T (the inhibition being in the refractory period of the next one, makes the FitzHugh- 
Nagumo spike shortly after). To pass from one state to the other we use a contracting input 
function with an input signal exhibiting the symmetry we want to see, in figure [5] we lead the 
system to the rotating wave and then back to silence. The system 

x\ = f(xi) - /ix 3 + ei + h 
%2 = f(x 2 ) - fixi + e 2 + h 
%3 = f(x 2 ) - fix 2 + e 3 + I 2 

h = A Xon(Ui(t) - Xi) 

Remark 5.1. The control input to get back to the silent mode is here a long step but can be 
any spatio-temporal identity signal ( equal for neuron 1, 2 and 3). Inspired from the visual 
saccades involving bursting, this long step could model a high frequency burst, being here a way 
to reinitialize our network to a silent state before a new computation cf [32J. 




Figure 4: 3 ring hysteresis system 
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5.4.3 Grid and group selection 



This example illustrate the idea of symmetry selection without changing the contraction condition 
( see section 5.2) and illustrating a common issue of 2D segmentation. The concept will be to use a 
toric grid being contracting toward M. a iu then to select thanks to the input the desired (necessarily 
flow invariant) groups. 

The grid is formed with neurons connected through diffusive connections ( representing gap 
junctions and other direct contacts between neurons ) to their four closest neighbors. We will 
set the coupling strength k to be strong enough to ensure contraction toward M. a ii ( it exists see 



balanced coupling in [24]). Following the control idea of section 5.2, the system will polysynchronize 
depending on the flow invariant subspaces found in the input u. 



Specifically we use a 5x5 grid of identical FN neurons modeled as ( 12 ). For each run, the initial 
conditions are set so that the neurons phase are spread out. We will consider 2 flow invariant 
patterns chosen among the one we can find in [33] , namely pattern 1 and 2 of figure [6j the coloring 
represents the wanted flow invariant groups, input J) ( resp. input A ) will represent the input of 
the white (resp. black) neurons. To separate the two groups of neurons but also showing some 
interesting interactions (we don't want all the neurons to be synchronized even if the FitzHugh- 
Nagumo model being a 2 dimensional model goes very easily to full synchrony with this grid 



connection) we chose (see plots in figure 7a) 



inputlli = 2sin(2vrt/60) + 21 
input Si = 10sin(27rt/8) - 20 

When we will say with noise we add to the input of each neuron a random noise taking a new 
value between and 1 each 0.05 second. 



We first apply pattern 1. Without coupling Figure 7b we observe the natural behavior of the 



FitzHugh-Nagumo model which 'synchronize' with its input quite easily as can be observed with 



one of the two groups. Setting k = 0.3 Figure [7c| gives the expected behavior, two groups appear 
exponentially fast. 

We then use the input to change the synchronized groups from pattern 1 to pattern 2 at time 
t = 150. First as expected the speed of convergence increase with k but also the synchrony among 
groups, indeed the coupling tends to synchronize groups also. 

Adding individual noise Figure [8] obviously prevent synchrony without the coupling, but with 
the coupling we obtain the desired grouping with some glitches allowed by the input continuity 
(the difference in the norms are always above a certain mean of the integral of the noises). 



21 




22 



(a) k = Q 




(b) k = 0.3 




(c) k = 0.7 

Figure 8: Grid pattern 1 followed by pattern 2 at t — 150 with noise 



6 Discussion 



Robustness and globalness are interesting properties of the studied methods. Many studies uses 
approximations about the trajectories, considering that the neurons are close to their limit cycle, for 
instance [Ml EHJ [36] • Since contraction is a global property, nothing is assumed about the location of 
the state of the system when we plug in a new input, allowing fast input-driven switching between 
different synchronization patterns. Global exponential convergence to the desired behaviors is 
obtained, with quantifiable convergence rates. Globalness also avoids some of the topological 
difficulties associated to the study of large networks of phase oscilllators. In the input continuity 
proof, only bounded signals are needed. 

The modularity of the tools is a strong property allowing to mix studies of networks done at 
different scales (neuron, neural mass, neural assemblies and so on). Indeed, while we use neuron 
models as our main dynamical system unit, the development can be applied to other dynamical 
systems networks. 

The symmetries used here are quite generic, the extension of spatial symmetries to linear 
operators and the extension to spatio-temporal symmetries seems important, since it is required 
to deal with the idea of spatio-temporal pattern coding in the brain, and natural external stimuli. 

Two main weaknessness can be pointed out: 

First our control over the symmetries of the system doesn't prevent the system to exhibit more 
symmetries in the end — mainly ensuring to have two synchronized groups of neurons doesn't 
prevent to have in fact total synchrony. To prevent the system to go to more synchrony, it is 
important in practice to actively separate the groups (as we did in the grid example), e.g. through 
inhibition, or break the symmetry. 

Second, the spatio-temporal case is very interesting and quite unexplored. In this paper we 
only drew conclusions for fully contracting systems, a restrictive condition. A relaxed condition 
similar to the existence of M. a ii in the spatial case would be more desriable (if perhaps unlikely). 

Finally, the small circuit of a main neuron and its inhibitory interneuron is interesting in its 
own right. This circuit is proposed as a plausible implementation of "contracting inputs" in section 
5.3 but also represents an frequency selector circuit as seen in example |7T Its biological relevance 



may be further investigated. 
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7 Appendix 



7.1 Frequency selector / contraction activator network 

The small classical cortical circuit : Figure [9] seems to be omnipresent on most cortical cells, set 
to treat the extracortical afferent excitations. [28] We have already seen that this network could 



be of great use to control the contraction of the system Section But with different parameters 
it can be an interesting frequency selector. 

We will use the fact that we can control the frequency of both neurons with the input (by 
synchronizing the neuron with the input), conjugated with a fixed delay of inter-inhibition which 
will be the intrinsic frequency shut down of this circuit : 




Figure 9: d — 11, big enough A' 



There is a main pyramidal neuron x p connected to its inhibitory interneuron Xi with a synaptic 
delay d. We set an input u with a specific frequency. First we use a frequency close to the 



corresponding delay, see Figure |10b| we see Xi which adapt to the input and then since the delay is 
of a close value, x n 



stops to spike. In Figure lOd we kept the delay of Figure 10b but set a further 



input frequency. 
The system : 



f(x p ) + e + X(u(t) - x p ) - WiXi(t - d) 
f{x i ) + e + \'{u{t)-x i ) 
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7.2 Input continuity precisions 
7.2.1 Lego game 

The input continuity as introduced in Section [5] and defined at ^ allow us to play the Lego game 
: plug in serial and parallel blocks having input continuity and get a bigger block with input 
continuity. To plug in serial, the property of the output of the first block should of course imply 
the property needed by the input of the second block. The parallel block is just a redefinition of 
the input and input space using for example as a new distance the sup of the two original distances. 
Feedbacks are of a different kind of plug and we will need some more refined analysis for example 
in two steps : block A has two input, one is a feedback, if we can prove input continuity of A 
depending only on the first input, we have some property of the output, then knowing that, we 
have some property of the feedback input and we have a new ( and eventually stronger ) input 
continuity of A using the full property that we now know on the input, giving the full. This kind 
of computation is close to the classical idea of predictive top-down signal which is used to improve 
the treatment of the feedforward input signal. 



7.2.2 Norms, distances and properties 

There is a lot of different coding we can think of being used , like phase, frequency, timing, spatial, 
etc ( some interesting examples among thousands [37J E2] ) Each defining different "distances" 
between signals and natural properties we could be tempted to prove on signals. In general we 
will have a pseudo-distance in the signal space but a real distance in the property space, with the 
equivalence classes x G [a] -<=>- d(x, a) = 0, representing signals with the same property. To 
generalize this idea, we can define a measure (p l : lR n h-> lR m of our signal which describe some 
properties that is if ^(xi) = (f t (x2) then x± and x 2 have the same property at time t, with this 
we have a generic pseudo-distance defined with the usual norm in the property space : 

d% t {x l ,x 2 ) = \\<p\x x ) -ip t {x 2 )\\ t m 
. This construction was used for the input continuity of systems contracting toward a linear 



subspace Section 4.2.2 



Remark 7.1. The interest of using a norm over using a distance : when is available a norm coming 
from a dot product, we can define orthogonal projection on subspaces, giving minimal distance 
between a real input and the space of desired input. 
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7.2.3 Classical codes and distances 



We can define several distances to represent classical coding or properties of neuronal networks : 

• a pseudo-distance for frequency coding : 

Considering the signals defined by their spiking times : and let T* be the mean 
distance between and t^ 1 before time t ( representing the mean period of spiking ) then 
we could use : 

d\x 1 ,x 2 ) = \T t Xi -T t X2 \ 

• a pseudo-distance for synchrony in a certain subspace defined by a projector V, remark that 
this is the one we mainly use throughout the paper: 

d t {x 1 ,x 2 ) = \V{x 1 )-V(x 2 )\ 
Depending on the signal representation, we will have different classical distances : 

• With signals as a set of spikes, described by the set of spike's dates : to signal u we associate 
{t u } so that u(t) = 1 if t G {r n } else 0. We can then define : 

d\u,v) = Yl (H Tfe ) " u fa)D with Tk e { r "> U M 

r k <t in {t u }U{t v } 

This one gives us a very precise distance between discrete spatiotemporal patterns but is too 
sensitive. 

Remark 7.2. Something important to notice is the fact that the distances is defined at a time 
t, and may have access to the history of the signal. The property can be varying with the 
time, since the distance is. 

• We can define sensitivity delay t £ also seen as refractory period, and use a kernel [38J : 

u(t)= K(t,rj:,{r u }) 

r£ in {r 11 } 

— K(.) = 5(t — t%) which gives a formalization of the above vision, 

— K(.) = 6{t - tf) The spike train itself Et» e ^ 6 ( f - *?) 

— K(.) = W t n-i , n (t) The normalized instantaneous frequency (t? being predicted after 
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K(.) = max non-causal measure of the instantaneous spike density, 

i t" ; 

AM, 



-t e -(*-*") 

— K(.) = (1 — e~)y(t — £") e t A r time-constant, low-pass filtered causal measure 
of. 

— K(.) = if i = then S else A representation of the 1st spike as in fast-brain 
mechanisms |39j with respect to a time reference t,. 

and then we can define instantaneous distances with 

d?(u,v) = |u(*) — | 

or define a more interesting distance as seen in the following, since thanks to the kernels we 
come back to real signal space. 

• With the vision of spike set, we can consider the signals as binary words (1 if the time is a 
spiking time, otherwise), and use the usual binary infinite word distances. This kind of 
norms can be useful if we are looking at some binary coded properties, or to do some binary 
computation [40J. Binary codes or barcodes |41j . 

• Some more statistical distances could be of interest, taking in account the probability of 
spiking with respect to the history by some Hebbian rule, for this we can be inspired by 
PI El SB] 

• Phase synchrony measure giving also a pseudo distance inspired by [IS] 

Distances in real signal space : R R , we can come back to the usual functional norms, with T 
the sensitivity window : 

N t 2 (u)= [ u(r) 2 dT or Nl(u)= [ \u(r)\dr 

Jt-T Jt-T 

or the convoluted of these ones, with /x > 

Nl(u)= [ u(t) 2 h(t -t)dr or N\{u) = [ \u(t)\/i(t - 1) dr 

Jt-T Jt-T 

And uses the norms as distances if we want with the usual : d t (u,v) = N l (u — v) 
We can list some properties of these norms : 
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• growing with T so the continuity with T implies the one with T' > T 

• fi will be very important to describe the system's sensitivity 

• if we consider u to be bounded it is sufficient to have // ~ \ to allow to have an infinite 



7.3 Contraction condition with help of symmetry 

We have seen that with the contraction condition verified, we can control the symmetry of the 
dynamics to control the solution. Actually, the symmetry of the system can also help us to simplify 
the proof of contraction itself. 

7.3.1 Circulant functions, symmetries and contraction conditions 

Lemma 9.1. A a-equivariance with a a cycle of the size of the space is something well known: M 
a-equivariant iff M is circulant. 

Proof. M a m x m matrix is circulant iff M seen as a quadratic form M(x,x) = x T Mx has the 
property M(x, ax) = M(cr _1 x, x) with a a m-cycle. On the other side we have a -1 = a T and 
M(x, ax) = x T Max = x T aMx = (a~ 1 x) T Mx by cr-equivariance. □ 

Remark 7.3. A matrix C is circulant iff it can be written as : 



window T 



The norms are the generic case of the norm defined earlier Equation [9] 



/ c(0) c(l) ... 
c(n-l) c(0) c(l) 



c(n-l)\ 



C 



\ 



) 



The eigenvalue of the symmetric part are also simple : 



n-l 




fc=0 
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We will consider a cx-equivariant (circulant cf 9.1) system /' in space E' of size n'.We define 

n'-l 

X'j = ^2d k focos(2jkn/n) 

k=0 

Remark 7.4. The A' are defined using the first composant of /' but thanks to the circulant property, 
it could be equivalently done using any other composant 

Then we can prove two interesting lemmas : 
Lemma 9.2. 

/' contracting with identity metric •<=>- Vj G [0..n — 1], A^ < (13) 

Lemma 9.3. 

V^V? < <=► Vj e [l..n' - 1], A; < (14) 

Remark 7.5. We have a condition of size n' — 1 as it should be. 
Remark 7.6. V' all = V' a 

With this two lemmas we have moreover a simple link between the contraction and the con- 
traction toward the subspace of synchrony. 



7.3.2 Discrete symmetric system 

We consider / a 7-equivariant system : 



fl = 7/ (15) 



We will consider that 7 is a permutation and use notation from Section pA\ U is the size of dj, 
Ej q correspond to the space invariant by the action of 7 which is of dimension q = n — £\ U since 
the cycles <Tj are chosen non-trivial. 

Such a 7-equivariant system will converge exponentially to a solution x = 7X if it has one of 
the contraction property. We will look at the strongest one : contraction toward Ai-y = {x = 7x}, 
and precisely at the sufficient condition Vy%V^ < with V^x = <^=^ x G A^ 7 . 

Theorem 10. 

V 7irK < ^ g [o.. P ] Vj g [1 . . . h - 1] , Xj,i < 



dx 

with 



k-i 

Aj.i = ^2d ki f 0i cos(2jkir/li 

k=0 
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ki being the indice of the kth element in the ith subspace (modulo k to stay in the ith subspace). 
For example for i = 1 we have k\ — l\ + k, (— 2)i = l\ + l 2 — 2 and fa = fi x 



Proof. 

Remark 7.7. x = jx is equivalent to the conjunction Vi E [0..p] x | nj a ^ = o~i \x\e„)- But x\e„. = 
°"j (^1^.) means that x is in synchrony inside each E ai : We want to prove a polysynchrony which 
can be done by proving the synchrony inside each group. 

We can relate this remark to 

V a T < 

Which leads us to us the result with Lemma 19.31 □ 

7.4 Proofs of Theorems, Lemma etc 
7.4.1 Theorem [7] 



V 1 V ? < ° 



df 
dx 



Proof. We have the hypothesis: 



Using the uniform continuity, 



Vr > t , Kt)|| < M', \\s(r)\\ < M' 
Vr>t , \\h(r)\\<M 



(16) 



We have 



AT-^(r) = / e a ^\\r(T)\\dr 



However from the robustness ([7]) 



Vr \\r(r)\\ < 



,Hv-t) 



\\Kv)\\dy 



We can apply Lemma 10.1 with t = — oo and define t\ the moment of the saturation 

e A( tl -t) _ 

~ M 



(17) 
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N-™f(r) < lim I*' e a ^— (l - e x ^) dr + f e^^rje^ dr 



which by calculus using the relation Equation 17 



From (18) we have the continuity, since all the powers of r\ are positives. □ 



Let's consider some cases : 



• if a < A We first have to say that we still have a positive term, since the exponent change also 

its sign, making ^1 — A j < then the fact that M is finite is important, otherwise 

this term will go to +oo and we can have in extreme cases some numerical surprises (even if 
we have continuity). 

• if a = A then by continuity we get the limit : - + -In { — ) so M should still be bounded to 
allow us to use this limit.. 

• if a > A then we can get rid of M and perhaps in first approximation, just keep the main 
term : 

Remark 7.8. If ti doesn't exist ( i.e. jt > 1 ) it first means that we did not took r/ small but the 



calculus gives just the first term of (18) which is still good 



Remark 7.9. We can also instead of using some case based calculus over the A and a use the lemma 



10. 2| to have a pseudo equivalence of all of these norms. 

Remark 7.10. We should see that in the preceding proof, A is taken as the contraction rate of the 
system, but we can use any A < A since (6| will still be true. 



Lemma 10.1. a boundary on the norm before t: 

Vi > r > t , / e p{y - r) H(y) dy < min L^ T ' , ^(1 - e^* ^) ) (19) 



to 



Remark : The inequality is an equality for 

H(y) = 



M ify<h, 
ifh<y<t 
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with t\ the moment of saturation if it exists : 

M 



P 



P(ti-t) _ Mto-t) 



) = V 



Proof. 



Vr >t , I < 
'to 



I e a{y ~ r) H(y)dy = e a{t ~ T) j e a{y ~ t] H (y) dy 

J to J to 



,a(t-r) 



h(T) 



however h(t ) = 0, h(t) = rj, h(r) = e a ^ T - t) H(y) 

from g6} < h(r) < Me a(T ^I 

< h(r) < min (tj , jf e^^Mdy^j 

< h(r) < min I 77 , 



'to 

Me~ at 



e aT — e at ° s 



□ 



Lemma 10.2. The possibility to change the a of the norm keeping a boundary: 



N-™{(d) < q( V ) 
with 



(20) 



q(rj) <i] if a < (3 



and q (T,)<f(%)* if < 



a 



Remark : it is also true that we keep the boundary with t ^ — oo but the result is less interesting. 



Proof. With the notation of lemma 10.1 

-t 



/3 



Jto 



Jt 



integrating by parts and taking the limit to = — oo when possible 
= h(t) + (a-/3) f /i(r)e (/3 - a)(T -* } dr 

Jto 
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for a > A and using the property of h(r) seen in lemma 10.1 



Me 



-at 



i e aT — e at 0\ e W-a)(r-t) 



Ut 



a 



r/e 



G9-a)(T-t) 



which gives us, with to = —oo ( which works without any new hypothesis) 

- Me /3(t!-t) v 



<V + (<x-P) 



and using the relation (17) 



< 



M /rja 



(3 \M 



a(3 (3 — a 



.(1 _ e (/3-«)(*i-*)) 



□ 



7.5 Proof of Lemma 9.3 



Proof. A natural projector to the subspace of synchrony is W: 

( 1 -1 ... \ 

o '•. '•. '•. ; 

\V=[-n-= : •-. •-. •-. o 

'•• '•• '•• -1 
\-l ... 1 / 

To use our natural projector, we first have to remark that it is not really a projector to the 
orthogonal space. Such a projector can be obtained by removing the redundancy inside W, because 
it is a system of dimension n but represent an hyperspace of dimension n — 1. 

Then this noticed, instead of looking for the condition V^^V^ < we will look for the 
equivalent condition Wt£\V t strictly negative except for one null eigenvalue. 



Of 
ox 



(psf r d s+ \f r (d s f r+1 d s+ if r+1 )) ( rjS ) e [ ..n'-l] 2 

(2d s f' r - ds^f',, - <9 s +l/r)(r,s)e[0..n'-l]2 USm S tllat d f is CUCulant 
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Remark 7.11. All indices are modulo n' . 
Remark 7.12. W is circulant. 

Since A is circulant (product of circulant matrix), it is defined by 

a(k) = A 0)k = 2d k f G - <9 fc -i/o - dfc+i/o 

We are interested in C its symmetric part. It is also a circulant matrix, so defined by c(k) k G 
[0..h - 1] : 

c(k) = a(k) + 2 a( ~ k) = \ (2d k f Q - «Wo - d k+l f Q + 2d. k f - S-(*-i)/o - d -(^)fo) 

One of the interest of circulant matrix is that we know their eigenvectors and associated eigen- 
values : taking w'j = e lL ^ one of the n'th. root of 1 ( w'™ = 1), we construct the eigenvector 

n'-l 

Vj = (1, w'p w'j 2 , . . . , w'j n 1 ) associated to the eigenvalue pij = c(k)wj k 

Remark 7.13. Since we took C symmetric (c(k) = c(—k)), the eigenvalues ^ are all real as one 
could remark regrouping c(A;)ti/ fe + c(—k)w'~ k = c(k)cos(2j kir / n') . 

With some simple regrouping : 

n'-l 

/4 = J2 c ( k H k = 2 (! - K + ^r 1 )/ 2 )^ = 2 (! - cos(2j7t/Z ))A; 

fc=0 

n'-l n'-l 

with A; = ^ dMwf + w'r k )/2 = d k f cos(2jkn/n') 

And : 

// = 

Vj G [l..n' - 1], sign{Xj) = sign{^) 

Since is of dimension n', but represent an'-l dimensional space, corresponding to /i' . 
Then by virtue of Theorem 1 of |23] the contraction to the subspace of synchrony E' all is ensured 
with Vj G [l..n' - 1], ^ < or equivalently Vj G [l..n' - 1], A^- < □ 
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7.6 Contraction toward A4 a ii using symmetry 

7.6.1 Proof of Lemma 14.41 

Let's recall the definition of a partial isometry : it is an isometry from the orthogonal of its kernel 
to its image. 

Proof. We take VV T = Ie m±} V 2 V 2 t = I Em± , and Vx G E M x, x T &VfV T Q- 1 x < 0. 

Note first that V 2 V T Q T QVV 2 T > 0. Indeed, 9 is invertible and Vy G E M ±, VV 2 T y = implies 
V 2 T y = (since Ai 2 C ■M ± ), which in turn implies y = (by definition). 

Next note that 

30 2 G GL(E M ±), \/y G E M2 , 3x G E M , V T Q- 1 x = V 2 T Q 2 1 y and V T Q T x = V 2 T Q^y 
Indeed, since VV T = Ie x ^ s ^ s equivalent to : 

36 2 G GL m , Wy G E M x, ®VV 2 T Q 2 l y = (Q^VV^y 

ae 2 g GL m , v 2 v T e T evv 2 T = &le 2 

where m is the dimension if the subspace E M ±, Q 2 exists because V 2 V T Q T QVV 2 T > 0. 

Finally, by unitary freedom of square roots for symmetric positive operators there exists a 
partial isometry U such that 9 2 = UQVV 2 T . Thus, 

&2V 2 fV 2 T & 2 1 = UQVV 2 T V 2 fV 2 T {UQVV 2 T )- 1 = UQVfV T ®- 1 U T < 

where the last expression is negative definite from the hypothesis. 

As is 02, U is defined up to isometries. We can thus take any U having the sufficient following 
properties. U T is basically the partial isometry embedding Em 2 i n Im{QVV 2 'Em 3 ) which is of 
the same dimension but in a bigger space : U T U projects E onto Im(QVV 2 T E M2 ) and UU T = 

7.6.2 Proof of Lemma Hj2 



Proof. Using a similar construction as in proof 7.6.1, with m the dimension of the subspace E M ±, 
we need 

ae 2 g GL m , v y g e m ^, evv 2 T e^ y = {Q T y l VV 2 T Q T 2 y 
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which is equivalent to : 

30 2 e GL rn , (V 2 T y l V T Q T QVV 2 T = Q T 2 Q 2 
(T T )- 1 9 T 9T T = G^Gs 

things works with T unitary, but if not unitary there are few chances for i to work. □ 
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